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ABSTRACT 

This information package offers guidelines on 
conducting program evaluations to improve services. Though the 
examples relate specifically to respite care services for families of 
individuals with disabilities, the information is more generally 
applicable. In the first of four factsheets, titled "Local Program 
Evaluation," the form of evaluation focuses on continuous quality 
improvement, and programs are seen as evolving and improving as they 
get information about their successes and accomplishments. Steps that 
need to be accomplished include: determine the scope of the 
evaluation, select appropriate evaluation methods, collect and 
analyze information, and report and utilize findings. The second 
factsheet, "Developing Evaluation Questions," divides evaluation 
questions into process questions and outcome questions. Process 
evaluation questions can be divided into structural questions and 
activity questions. Outcome questions require knowledge of how 
program activities relate to changes in consumer, family, and 
community behavior, attitudes, knowledge, skills, or intentions. A 
theory of action is used to provide links between current activity 
and future intended goals. The third factsheet, "Evaluation 
Measures," examines what is to be measured, how it will be measured, 
and who will complete the measure. The final factsheet on developing 
evaluation reports lists ways of communicating evaluation results and 
examines the components of a good evaluation report, including verbal 
and numerical descriptions of data. (JDD) 
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Local Program Evaluation 



**W€ should be carefid to get out of an expe- 
rience only the wisdom that is in it.. .the cat 
that sits down on a hot stove lid will never sit 
on a hot stove lid again — and that is well; but 
also she will never sit down on a cold one any 
more. " 

Marie Twain 

Background 

While there may be many ways of approaching evalu- 
ation, the focus of this factsheet will be on evaluation 
activities conducted to improve the service system 
rather than activities with a research focus. With this in 
mind, the characteristics of program evaluation are: 

• it involves the gathering of information about a 
program's int^tions, itsactivities, and the impact 
of these activides; 

• it is a management or administrative activity; 

• it is planned, purposeful and ^stematic; and» 

• it is meant to improve services. 

Program evaluation is an activity which summarizes 
the accomplishments of a program. Itcan be performed 
as a separate activity from the ongoing managem^t of 
the program, or, evaluation can be a management tooi 
which routinely gives information back to the program 
for the purpose of changing it, improving it, and 
renewing it. The form of evaluation charted below is 
consistent with a continuous quality improvement in 
which programs are seen sts evolving and improving as 
they get information about their successes and accom- 
plishments. 

Planning 
Implementation Evaluation 



The following steps need to be accomplished in order 
to plan, implement and use program evaluation: 

Determine the Scope of the Evaluation 

1. Identify the purpose of the evahuUion. 

• What issues or key questions about the program 
are to be addressed by the evaluation? 

• Who are the primary users of the evaluation and 
what are their key concerns? 

• Who needs to be involved in discussions about the 
evaluation: program managers, clients, direct ser- 
vice staff, funders, etc. 

• Are some evaluation findings needed to satisfy 
requirements of an outside agency? Are specific 
requirements mandated, e.g., use of particular 
instrum^ts, reports with specific content or for- 
mat? 

2. Assure that there is a good understanding of the 
program. 

• Are there written documents which describe the 
program, its goals and objectives, and its opera- 
tions? 

• What are the ejis^g sources of information about 
the program's activities, staff, conspumers, and 
outcomes? 

• What is the program's philosophy? Are there 
program implementation directives or guides? 

• What is the scope of program activities? How 
many staff, consumers, and sites exist? 

• Who is affected'l)y the program? (Who are the 
consumers?) How are they supposed to be af- 
fected? Describe how the program's activities are 
expected to result in changes to the consumers, 
their families, and the community at large. 

3. Begin to develop the focus of the evaluation 

• The focus of the evaluation may be to clarify 
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program goals; successes or problems with pro- 
gram implementation; consumer satisfaction; the 
financial feasibility of the services; \diether or not 
theprognun meets theneedsof the community; or» 
progress on intended outcomes. 

Select Appropriate Evaluation Methods 

1. Make sure that you are asking the right questions, 
which focus on key aspects of the program. 

• Re-examine the reasons for doing the evaluation. 
Is it for an external agency (are there any require- 
ments)? If for internal use, y/haX are the conc^ns 
orneedswhichledtotherequest for an evaluation? 

• Make the questions specific enough to focus the 
assessments^ obs^ations^ and comparisons to be 
made. Scrutinize each question to think how to ask 
it more i^pecifically. For each outcome, try to 
imagine how you would know when you have 
achieved it. 

2. Determine how to coliect the information you want. 

• For each question, develop a set of tangible 
behaviors or events which represent the activity or 
event under focus. They can be verbal responses to 
a posed question^ or responses on a paper and 
pencil instrument 

• Check to see if information or data are already 
available for the measures being developed. Staff 
and consumer activity may have already been 
collected. Information about the consumers may 
have been collected during the initial contact 

• If the information is not readily available, select 
measures or instruments you may want to use. 

3. Determine from whom data will be collected. 

• Information about consumers^ staff, and activities 
has probably been collected already (all intake 
formSy all staff activities^ etc.). If not, then it must 
bedetennined information will be collected; 
from which sites; and which people or groups will 
be the focus of the data collection. 

4. Estimate the cost of the evaluation (revise plans 
based on the estimate). 

Collect and Analyze Information 

1. Construct or purchase instruments \f the data or 
information does not exist in program records. (See 
Factsheet number 14 on Evaluation Measures for 
more detailed information.) 

2. Set deadlines for data collection. 

• For example, start with the deadline for an interim 
report, or the date on which an important meeting 



is totakeplacewhenthedatawillbeneeded. Work 
back from that date; set deadlines and expecta- 
tions. Be realistic: activities ofttn take longer to 
accomplish than expected. 

• Determine who will be responsible for each task. 

• Determinewhetherany training will be necessaiy 
and schedule it 

• Determine if any additional staffing will be needed 
for such tasks as data collection, coding, editing 
and analysis. 

3. Set expectations for interpreting the data. 

• Before starting to collect data, try to talk with the 
primary users of the evaluation and have them 
decidehowtheresultswillbeinteipreted. Theway 
in >^ch data are collected, the sources of thedata, 
and the analysis of the data may be affected by the 
answers to these questions. 

• To what extent can the evaluation plan be altered 
after it has begim? Can it be altered by time, by 
data collected, or by type of analysis? 

4. Check to see that the data collection is implemented 
as planned. 

5. Analyze data with an eye toward program 
improvement 

If the evaluation has focused on specific program units, 
it is important to consider the following points: 

• The component's iniplen>entation, compared to its 
intentions. 

• Consumer's attitudes about the program compo- 
nent in question. 

• Consumer's achievement/performance as a result 
of the program. 

Report and Utilize findings 

1. Decide how to communicate results. 

• Consider the fiill nnge of strategies available and 
use more than one if appropriate. For example: 
informal communications 0n the hall, over coffee, 
before and after meetings); less foraial meetings 
(smaU groups, no minutes); fonnal meetings; memos; 
writtenr^rts; newsletters; electronic communica- 
tion; visual presentotions (slide show, video show); 
public meetings; and local media. 

2. Meet withprogram managers or stqffto discuss and 
follow up on findings. 

• This step may take place a number of times. Each 
time there may need to be a revision in the 
presentation of the results. 

• The findings, regardless of how they are pre- 
sented, should discuss some or all of the follow- 



ing: program operations; consumer satisfaction; 
whether the program is being implemented as 
planned; the effect of the program on the primary 
coQsmners; the strengths and weaknesses of the 
program; outside factors that are influencing the 
program; key problems that have occurred or that 
might be anticipated; adequacy of progress toward 
program outcomes; and, the differential effective- 
ness of the program under particular conditions or 
with particular individuals* 

• Include specific program recommendations with 
the idea that the original puipose of the evaluation 
was to change and improve the program. 

Summary 

There are many kinds of program evaluation activities. 
What characterizes all of them is that they seek to 
enable us to ""know" about programs rather than to 
guess about them. Therefore, evaluation activities are 
planned, purposeful, and systematic in the way they 
ask and answer questions about the program. 

References 
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tudes. Newbmy Park, CA; Sage Publication. 
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Developing Evaluation Questions 



The evaluation focus will determine the questions 
asked. An evaluation can occur at different points in the 
program cycle. A program engages in very concrete 
sets of services, which may, or may not, lead to 
outcomes for the consumer, family of the consumer, or 
the community at large. In addition, the outcomes may 
occur immediately during or after the program is 
offered, or some time later. All of this can be summa- 
rized in the following chart. 
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Developing Process Questions 

Proces.. "ivaluationhelps answer questions about whether 
or not the ongoing program is functioning as it was 
intended. It is also the most helpful tool for program 
managers in operating the program on a day to day 
basis. Process evaluation addtesses the ongoing pro- 
gram structure and activities. Questions such as those 
on the following list are important for process evalua- 
tion. 

• Is the appropriate structure in place to maintain the 
program? 

• Is the appropriate staff in place to offer the 
intended program? 

• Are the people receiving the service those who 
were identified as most in need? 

• Are the services which are being provided those 
which were intended to be provided? 

• Are consumers receiving the amount of service 
they need? 



Process evaluation can be divided into structural ques- 
tions and ac//v//y questions. Structural questions relate 
to resources and organization, whereas activity ques- 
tions relate to staff and consumer behaviors. 

Structural Questions 

Structural questions are similar to standards for licens- 
ing or accreditation. It is generally believed that some 
organization and resources are needed to properly run 
a program. Some structural questions are: 

• Is there a written statement of the philosophy and 
approach to services, a mission statement? 

• Is there an administrative structure which would 
ifupport a program (organizational chart, board of 
directors, personnel policy, hiring practices which 
are consistent with philosophy and program in- 
tent, etc.)? 

• Does the physical setting of the program conform 
to the program's intent? 

• Are there proper procedures for consumer in- 
volvement in program planning and evaluation; 
recruitment and enrollment; and routine and emer- 
gency program operations? 

• Are there mechanisms for accotmtability? 

Activity Questions 

Activity questions are aimed at actual staff and con- 
sumer behavior. Staff activity relates to: 

• What lands of activities did staff engage in? 

• How much did each staff member do? 

• To which consumers did the staff give service? 

• Where did the staff provide the service? 



Staff activity should imply consumer activity, but it 
may not. Another set of questions, similar to staff 
questions, can be asked about consumers: 

• What kinds andhow many consimiers wereserved? 

• What kinds of services were offered and in v/bsX 
intensity? 

• At what times and in what settings were the 
services received? 

Being able to document that there is an active program 
is an important accountability activity. It is also impor- 
tant for internal program management to know who is 
engaged in what activity. 

Developing Outcome Questions 

In order to develop short or long term outcome ques- 
tions, it is inaportant to know clearly how the program 
activities relate to changes in consumer, family, and 
conomunity behavior, atitudes, knowledge, skills or 
intentions. The ""modeP which relates the mundane 
activities of the program to the short and long term 
outcomes and impacts in the consumers, families and 
community is called a theory of action. 

The theory of action provides links betwe^ current 
activity and future intended goals. To develop a theory 
of action just keep asking, **Why do we do this?** 

What is expected to be the immediate result of a 
program action? By repeating this question for each 
step of the theory of action, you develop a linkage 
between program activities and future changes in 
consumer, family or community behavior, attitudes, 
knowledge, skills or intentions. The outcome of one 
activity is xisually the next "activity" so that a chain 
develops linking the program's services with longer 
term outcomes (see chart below). 



With this set of linkages, choices can be made about 
what is an appropriate outcome, when it is likely to 
occur, and what should be the focus of an evaluation 
effort. 

Summary 

Evaluation questions should follow from a thorough 
understandingof theprogram*soperations, intentions, 
and consumers. When developing a theory of action, 
choices can be made about what is an appropriate 
outcome, when it is likely to occur, and what should be 
the focus of an evaluation efiort. 

References 

Fitz-Oibbons, Carol Tayler (1987). How to Design a 
Program Evaluation. Newbury Part, CA; Sage Publi- 
cation. 

King, Jean A. (1987). How to Assess Program Imple- 
mentation. Newbury Park, CA; Sage Publication. 

Patton, Michael Quinn (1987). How to Use Qualitative 
Methods in Evaluation. Newbury Park, CA; Sage 
Publications. 

Shadish, William R. , Cook, Thomas D. , and Leviton, 
Laura C. {1991) Foundations of Program Evaluation: 
Theories of Practice. Newbury Park, CA; Sage Publi- 
cation. 

About the Authors: David B. Langmyer, Hi.D., is an 
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*Note on Outcome Chart (left): measuring this as an 
outcome requires a sophisticated evaluation design. 
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Visit the operators of a women's shelter 

Operators develop knowledge 
of the programs offered 

Referrals increase 

Provide temporary child care to families in need 

Families can experience relief 
from child care burden 

Families experience and report reduction in stress 

Families experience less anger 
and frustration toward child 

Less child abuse experienced and reported* 
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Evaluation Measures 



Introduction 

In selecting or developing measures for evaluation 
questions or objectives, three questions always have to 
be answered: 

• What is to be measured? 

• How will it be nieasured? 

• Who will con^lete the measure? 

What is to be measured? 

Evaluation measures may focus on the following: 
behaviors, consumer saxlsfaction, knowledge, skills, 
attitudes, beliefs, or events. 

In focusing on the process evaluation of program 
activities and short tenn outcomes, wiut is measured 
primarily includes staff and program events as well as 
consumer changes in knowledge, attitudes and beliefs. 
The real payoff for most programs is changes in 
behavior, which might take place at a later time and in 
a different setting. 

How will it be measured? 

A complete list of measurement strategies is impossible 
to formulate because any activity which yields infor- 
mation can be a measurement method . The number of 
such activities is limited only by the imagination and 
resourcefulness of the person planning the evaluation. 
Common measurement strategies can be summarized 
into the following five categories: 

Program Records: existing records, documents, intake 
and discharge forms. Program records are most useful 
for evaluations of program activities. Commonly, sta'f 
activities and other program activities are routinely 
captured. In addition, intake information is often 
routinely recorded. Using this information can be 
inexpensive and non-intrusive since it already exists. If 
the information is not suitable, it may be possible to 
make small changes in what is recorded, how often it 



is recorded, or some other aspect of the program record 
to make the information useful for evaluation pur- 
poses. 

Public Domain Records: government statistics and 
documents. Public domain records can be helpful in 
knowing how a program is affecting the community at 
large. A crisis nursery program may be intended to 
reduce the incidence of child abuse, and the public 
record of the number of r^)orted incidents might be 
used as an outcome indicator. In addition, individuals 
in the program can be matched with public records. 
This might include driving records, arrest and convic- 
tion records, or school records. 

Behavioral Observations: observations, simulations, 
demonstrations, and physical evidence. Bdiavioral 
observations can be helpful if the program intends to 
teach particular skills or behaviors. Observing par^ts 
interacting wth their child provides an opportunity for 
programs to demonstrate alternative and non-abusive 
methods of discipline. Observing parents at play with 
their child could demonstrate how parents are integrat- 
ing physical therapy activities along with the play 
activities. 

Interviews: structured interviews, atid clinical exami- 
nations. Interviews are a rich source of information. 
Aside from the informant responding to formal ques- 
tionSy it also gives participants a chance to talk about 
the program and the individual's participation in the 
program. 

Paper and Pencil Instrttments: questionnaires, rat- 
ings, diaries, surveys. Paper and pencil tests will be 
discussed further in the section on *'choosing a mea- 
sure." 

Who will complete the measure? 

The source of the information is not always a matter of 
choice; but often the **same'' information can be 
gathered from a number of sources, e.g., belief about 
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the stress level of a family can come from the mother, 
the father, other family members, program staff, or 
professional consultants. In general, the choices for 
source of information are: program records; program 
recipient (client); family members, friends, co-work- 
^; program sti0; or another observer or profes- 
sionaL 

Confidentiality 

Whateve*. die source of information^ attention must be 
paid tj coolidentiality. There are two factors in confi- 
dentiality: (a) doing no harm, (b) informed consent. 

Doing No Hann 

The way in whidb you collect and report information 
must not do harm to consumers, staff, or others 
associated with the program. Obviously, personal 
identifying information must not be included on data 
collection forms or reports. In addition, the manner in 
which information is gathered should not, in and of 
itself, pose a physical, psychological, or social threat 
to an individual. In some cases, just revealmg that an 
individual is receiving services is damaging. 

Informed Consent 

Informed consent is a strong protection for the partici- 
pant in an evaluation* Under this principle, an indi- 
vidual participates in the evaluation only aft^ being 
fiiUy told wiiat would beexpected of them in participat- 
ing, and any conceivable risks of participating. This 
would include the methods that will be employed to 
preserve the anonymity of the individual. Depending 
on the source of the information, and the puiposes for 
which the information is to be used, federal guidelines 
do not always require informed consent, but it is 
always the surest way of protecting the program and the 
consumers who participate in an evaluation. 

Cfaioosing a Measure 

Measuring kno>^edge, attitudes, beliefs, skills and 
even observing behaviors is a deceptively sinq)le task. 
It is easy to do incorrectly. Whether dealt with openly 
or not, any measure is subject to issues of (a) reliability 

and (b) validity. 

J* 

Reliability 

Reliability is the consistency of the measure. Would 
you get the same response if taken again under similar 
conditions? How different would the measure be under 
alternative conditions, such as a different time or 
setting? 

Validiiy 

Validity is the extent to which an instrument measures 



what it is intended to measure. Often the most common 
formof validity is **nominal validity," that is, thename 
of the test is the same as the indicator of interest; but 
this is not really adequate. 

Fortunately, most measuies used in program evalua- 
tion are obvious. Tliey involve program, staff and 
participant event information which is easily observed 
and recorded. Any differences between what is re- 
corded as happening and what actually happened are 
usually trivial. For example, the sign-in sheet used to 
count the number of participants may be **ofF* by one 
or two, but that may not be a big enough error to 
warrant abandoning the use of ihe sign-in sheet. 

When it is necessary to assess something other fcan 
program ev^ts or records, the choice is between using 
or adapting an existing measure, or constructing a new 
one. It is worth a fair amount of searching to locate 
measures diat have already proven themselves. Instru- 
ments with a history of use usually have information 
about reliability, validity, and vliich populations are 
appropriate for their use. 

Finding previously used measures is not always easy. 
A literature search is a good place to start. Contact with 
odier crisis nursery or respite care providers can help, 
as can contact with a national clearinghouse or resource 
center. Wherever you find possible measures, the 
following list of information may be helpful in decid- 
ing if a measure can be useful. 

General Reference I^fomtaiion 

• What is the name of the measure? 

• Who is the author? 

• Who is the publisher? 

• What is the date of publication? 

• What is the cost? 

• How long does it take to administer? 

Validity InformoHon 

• With wizat sort of groups has the measure been 
employed? 

• With vfhaX other measures has this measure been 
correlated? 

• With what later outcomes has this measure been 
correlated? 

• How accurate a prediction does the measure give 
of significant outside criteria? 

• How closely do the measures' reported objectives 
correspond to your objectives? 

• What have reviewers and critics said about the 
measure? 



Reliability Information 

Do the authors indicate the size and nature of 
groups for which data is reported? 

Do they indicate the type of reliability coefficient 
computed? 

Do they give the mean and standard deviation for 
the groups? 

Do they report reliability for each type of group 
that may be included in the evaluation? 

Practical Considerations 

Are the instructions and procedures suited Co your 
population? 

Are the time requirements reasonable for your 
purposes? 

Is the form to be used legible, attractive and 
convenient? 

How much time is required in scoring the mea- 
sure? 

Do you or your staff have the skills to administer 
and score the instrumenL If not, are there ftmds 
available to hire someone? 

Were the nonns for the measure developed on a 
similar population? 

How much does the measure cost when employed 
in your situation? 

Summary 

Selecting the evaluation measures is one of the more 
critical activities when developing an evaluation pro- 
gram. Whatever a program*s intentions are in provid- 
ing a service, or in changing the lives of consumers, 
what is chosen to be measured will be the way the 
program is judged. 
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Data Analysis and Presentation 

Developing the Evaluation Report 



Introduction 

The evaluation "'report" is one of the most important 
parts of the evaluation. It is the official xecoid of the 
evaluation. For many people it is the only part of the 
evaluation tiiat is seen. A good evaluation ^'report" 
answers some or all of the evaluation questicHis. An 
evaluation "^report" does not have to be a written 
report! However, tiiere should be a written document 
available to the agency. 

Thejt are many ways of communicating results of an 
evaluation including: 

• informal commumcaiwnsiinihehsiU^ over coffe^^ 
before and after meetii gs); 

« less formal meetings (small groups^ no minutes); 

• formal meetings; 

• memos; 

• written reports; 

• newsletters; 

• electronic communication; 

• vt;^ presentations (slide show» video show); 
« public meetings; and 

« local media presentations. 
A good evaluation report: 

• describes the program and the steps in the evalu- 
ation; 

« explains the procedures used; 

« presents the findings; 

« draws conclusions about those findings; 

« and is prepared with the audience in mind. 

More than one report is frequently useful. A report is 
often used ior different purposes, and with different 
audiences. Many people do not need a long R^rt, or 
even a written report. A short summary report, or a 



verbal report, will satisfy the needs of such an audi- 
ence. Ontheotherhand» somepeople need the detailed 
information which can only be provided by a long 
report There is also reason to have a more detailed 
report for archival purposes. 

Presenting the Data 

In general, most evaluations conducted by local pro- 
grams would lead themsdives to descriptive analysis of 
data. Descriptive analysis is a way of snmmariTing and 
aggregating results from groups. If an evaluation has 
been conducted which employs a control group, or 
measures changes in program participants over time, 
then it might be appropriate to employ inferential 
analysis in which a decision is made about whether the 
particular results of thestudy are ^real**. Moreempha- 
sis will be placed on descriptive analysis in this fact 
sheet. 

Verbal Description of Data 

Many reports rely on narrative information to present 
mctst, if notall, of theneccssary information. Narrative 
inf armation may be presented in three ways: standard 
writing style; tables; and/or, figures, diagrams, maps, 
and charts. 

Standard writing style f that is, flieuseof sentencesand 
paragraphs, is often the best way to present informa- 
tion, especially to audiences that are not accustomed to 
working with charts, graphs, tables, numbers, etc. It is 
the only way to present information such as examples 
and explanations. If standard writing style is used to 
summariTC the results of open ended questions (** What 
do you like most about the program?**), it is often 
useful to give some indication of how often a particular 
response was given. 
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Tables r^resent narrattive or numerical infonnation in 
tab^ilar fashion. A table arranges infonnation in rows 
or columns, so (hat data elements may be referred to 
easily. They provideaclearandsuccinctway to present 
data, and are often more simple and understandable 
than standard vm6ng style. They also fidlitate the 
int^retation of data. 









Wedgewood 
Day Care 


7:30-6:00 
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Day 


Crystal 
Home 


24 Hours 


Center Based 
Overnight 



Figure 1 : Program Site Table 

Figures^ diagramSf maps and charts present veabal 
infonnation visually. They often describe information 
more cleady than several paragraphs of description. 
Common forms of figures are: flow cbuts; oiganiza- 
tion charts; GANT charts; and/or maps. 

¥loM9 charts are paiticulariy useful for presenting 
relationships and/or describing (he sequence of 
events and the location and result of decisions. 

Organization charts MxcvstM for presenting the 
chain of ::tq>onsibiIity in a prognun. 

GAiVT cAo/ts list a set of tasks. They indicate the 
time eadi task is to be performed and by whom. 

Maps visually describe certain geographical ar- 
eas. They are useful in describing different condi- 
tions for individual geographical areas. 

Numerical Description of Data 

Data are not only described in narrative, they are often 
described numnically. Threeof the most basic types of 
summarization are: 

• frequency distribution; 

• percent; and 

• average. 

Each of these types of summarization may be presented 
as part of the text or arranged in tables or figures 
(graphs). Inclusion as part of text ("The average age 
for children served was 18 months **) is an obvious way 
(orqwrtdata. 

Frequency distribution determines the number of units 
(e.g.» people) wliich fall into each of a series of 
specified categories. In order to do a frequency distri- 
bution one must have categories. Reporting on age, for 
example, requires that you group the data first before 



constructing a frequency distribution (e.g. , ^birth to 2 
years, or ^'S to 5 years''). The evaluation might look 
to see how many parents were members of particular 
racial or ethnic categories, how many were known to 
protective services, or how many were referred from a 
range of referral sources. 

Frequency distributions are not limited to descriptions 
of consumer characteristics. Program activity can also 
be presented cat^orically. The frequency distribu- 
tions can be presented as tables or graphs (usually bar 
graphs). See figures 2 and 3 for examples. 
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Rgure 2: Family Type Table 
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Figure 3: Family Type Bar Chart 

Percent is another useful way of describing data. A 
frequency count can be conv^ted to percent by divid- 
ing the ntmiber of units for a particular category by the 
total number of units and multiplying by IGO. Percents 
are often more easily imd^tood than the correspond- 
ing frequency counts. Percents can be represented in 
the same marmeM-as frequency counts. In addition, a pie 
chart is useful in breaking the total group of people into 
the percentage of the total represented by each cat- 
egory. See Figure 4 for an example. 
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Figure 4: Crisis Nurser/ Percents 

An average is a way of summariring all of the infonna- 
tion into one number. It can be used with data which is 
non-^axegorical numerical data. You cannot have a 
numerical avenige for gender or lace, for example. 
Using a numerical average is veiy powerful, but it can 
also be misleading. A few data points which are very 
different from theoth^could substantially change the 
numerical average. For example, if theagesof children 
you serve are generally between 1 and 3 years, but you 
get one child wiio is 18, the average may be thrown off. 
Averages can be i^iesented in tables or graphs. 



Average Length of Respite Care 
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Number of Scores = 5; Average = Total Hours 
(32) divided by Number of Scores (5). Tlie 
average length of respite = 6.4 Hours 



Condasion 

There are some thingo which can be done to encourage 
the utilization of evaluation results: 

• Write a good report which attends to the important 
issues which were raised in planning for the 
evaiiiation. 

• Write a r^)ort which pays attention to ihe auc^ . r:n'.:e* s 
needs and abilities. 

• Make concrete and t\sable recommendations. 

• Involve the program staff in all steps of the 
evaluation process. 

• Disseminate the results in various ways and in 
various settings. 

• Write a report which can be easily understood by 
those who receive it* 
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Figuie 5: Average Hours of Respite Care 
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